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ABSTRACT 

NASA considers Flash Lidar a critical technology for enabling autonomous safe landing of futute large robotic and 
crewed vehicles on the surface of the Moon and Mars. Flash Lrdtr can generate 3-Dimensional images of the terrain to 
identify hazardous features such as craters, rocks, and steep slopes during the final stages of descent and landing. The 
onboard flight computer can use tire 3-D map of terain to guide the vehicle to a safe site. 

The capabilities of Flash Lidar technology were evaluated through a series of static tests using a calibrated target and 
through dynamic tests aboard a helicopter and a fixed wing auctarft Tire aircraft flight tests were perfumed over Moon- 
like terrain in the California and Nevada deserts. This paper briefly describes tlie Flash Lidar static and aircraft flight test 
results. Tliese test results are analyzed against the landing application requirements to identify the areas of technology 
improvement. The ongoing technology advancement activities are then explained and their goals are described. 
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I. INRODUCTION 

The imaging Flash Lidar is being considered as the primary sensor, due to its ability to provide 3 -Dimensional images of 
surfaces and hazards, for future robotic and manned landing missions to tlie Moon and Mars. An imaging lidar system 
records a three dimensional (3D) image of a scene by conv erting intensity versus time of flight of short laser pulses into 
intensity versus distance along tlie line of sight for each spatially resolved area within a 2D image. In older, more 
conventional imaging lidar systems, each 2D pixel is recorded with a separate laser pulse. Thus many laser pulses are 
required to record large, multi-pixel images. A Flash Lidar system records full 3D images with a single laser pulse, 
permitting higher data rates and freezing out movement w ithin the scene and motion of live transmitter receiver platform. 
The need for high speed raster scanners to sequentially address image pixels is also eliminated. The receiver is much like 
the familiar digital camera. but with “smart pixels" that are capable of recording the required sequential temporal 
information. NASA Langley Research Center (NASA-LaRC) has been assessing the potentials of Flash Lidar technology 
as a landing sensor and working on its advancement under tlie Autonomous Landing and Hazard Avoidance (ALHAT) 
project for the past 3 years. The ALHAT project, led by NASA Johnson Space Center, is established by NASA to 
dev elop and demonstrate a guidance, navigation, and control system for future lunar missions capable of terrain hazard 
avoidance and precision landing under any lighting conditions anywhere on the Moon 1 



Figure 1 . Future lurar landing missions arc consi&nng scientifically interesting sites near craters and rough terrains. 


To fulfill the requirements of global lunar access under any lighting conditions, ALHAT is putsuutg active sensor 
technology development and maturation to implement five sensor functions. Altimetry, Velocimetry, Terrain Relative 
Navigation (TRN). Hazard Detection and Avoidance (HDA) and Hazard Relative Navigation (HRN |. Table I below lists 
the ALHAT sensor suite and their top level performance specifications fot achieving each of required functions with 
some degtee of redundancy. Flash Lidar is being considered fot performing all these functions w ith exception of 
velocimetry for which a Doppler Lidar is being developed. The ability of the Doppler Lidar to ptnvtde velocity data with 
approximately I envsee is highly attractive for precision landing. Additionally, the Doppler Lidar provides high 
resolution altitude and ground-relative attitude data that may fuitlter improve precision navigation to live identified 
landing site. Description of the Doppler lidar and its capabilities have been reported eatliet ' The Laser Altimeter 
provides independent altitude data ovet a large operational altitude range of 20 km to 100 m. All three laser sensors have 
a nominal update rate of 30 Hz. 


Table 1. ALHAT Sensor Suite 


Sensor 

Function 

Operational Altitude Range 

Prccisioit'Kcsolulhiii 

Flash Lidar 

HDATIRN 

ItXKi m- 100 m 

5 cm 40 cm 

TRN 

1 S km - 5 km 

20 cm'6 in 

Altimetry 

20 km - 100 m 

20 cm 

Doppler Lidar 

Velocimetry 

2500 m - 10 m 

1 cnv'sec 

Altimetry 

2500 m - 10 m 

5 em 

Laser Altimeter 

Altimetry 

20 km 100 m 

20 cm 


All five of the aforementioned functions provide input to the navigation filter for Landing Vehicle “state" estimation, 
tlight trajectory retargeting, and maneuvering to a safe site. Of these five functions. Altimetry and Velocimetry are direct 
sensor measurements, whereas the TRN, HDA. and HRN functions can be considered relative measurements, since tire 
sensor “output" is derived from a correlation with either "a priori" terrain information, or with a sequence of previous 
sensor measurements. The later functions can also be considered techniques, since a number of sensor algoritlun 
combinations can achieve similar results under the appropriate concept of operation. The location determination of safe 
landing sites is made from the location determination of lu/ards. simultaneously reeonled within full 3-D images in 
complete spatial and temporal resolution. The simultaneity of the recording of full 3 D scenes with single laser pulses 




























not only enable* more rapid acquisition, but simpler and more rapid processing of scene information to enable the time- 
sensitive precision navigation necessary to avoid hazards and land precisely at the retargeted location. 


2. FLASH LIDAR OPERATION AL CONCEPT 


As noted above. the Flash Lidar serves as a multi-functional sensor capable of performing 4 out of 5 ALHAT ftinctions. 
The current operational concept is based on a Flash Lidar system capable of generating 256x256 pixels image frames 
from a nominally I km distance. The Flash Lidar initiates its operation in an altimeter mode after the vehicle begins its 
breaking phase and its altitude drops to about 20 km above the ground. In this mode of operation, the lidar transmitter 
laser is focused such that only a few of the detector array pixels are illuminated. This increases tlie operational range of 
the lidar from I km w ith all of its pixels illuminated to the 20 km with about 100 illuminated pixels. The altitude data is 
then provided to the flight computer to update the Inertial Measurement Unit (1MU) data and improve the vehicle 
position estimate from more than I km to about 300 m. 

At about 15 km above the ground, the Flash Lidar will switch to the TRN mode by slightly increasing the transmitter 
beam divergence to illuminate about 200 pixels. In this mode, the Flash Lidar will continue to provide altitude data as 
well as generating consecutiv e 3-D images of the terrain with a lateral resolution of less than 6 m that is sufficient for 
performing the TRN function. Tlie acquired images are correlated with stored on-board reference maps of known 
features such as craters and surface elev ation data. The correlations are used to estimate tlie relative position error (map- 
tie error) betw een the sur face and the inertial frames of the vehicle. Correlation of the Flash Lidar data with the surface 
elevation data obtained from prior orbiting laser altimeters are particularly reliable in estimating the map-tie error, 
thereby enabling the TRN algorithm to generate the trajectory correction needed for bringing the vehicle to within 30 ill 
of tlie landing target. 
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Figure 2. Operational scenario of landing sensors. 


After completion of the TRN function at about 5 km above the ground, the lidar continues to provide altitude data so that 
the navigation error can be bounded. At about I km altitude, the lasei beam diveigenee is incteased to match the full 
field of view of the lidar receiver to begin its most critical function, which is hazard detection and av oidance hazard 


relative navigation (HDAHRN). The HDAHRN function requires deieclion of rocks and surface features greater than 
30 cm in height, slopes greater than 5“ over the diagonal of the footprint of the landing v ehicle, and determination of 
position of landmarks to better than 1 m relative to the specified landing location (see Figure 3). 

Vatious concepts for sensor operation and 3-D image acquisition aie being evaluated. Each concept must provide the 
necessary information for achieving tlie ALHAT HDA.HRN performance goals and simultaneously provide situational 
awareness information. The primary metric for evaluating an operations concept is •'robustness'*, i.e. how efficiently, 
accurately, and reliably live job gets done. In tlie context of ALHAT this means tlrat the operations concept must be fast, 
accurate, and be able to provide redundant information for real-time validation of tlie ''decisions" or choices that it 
makes. All three of these descriptors ate coupled in the sense that they all need to occur simultaneously for ALHAT to 
have credibility as a system. 

A concept of operation, similar to “targetmg" that employs some of the capabilities being developed above, is termed as 
“intelligent" safe site selection using precision navigation. Here HDAHRN have been coupled both in hardware and 
software since tl« process of determining hazard location is also tlie process for determining "landmarks" for relative 
navigation and can be done using tlie same sequence of 3-D images from the Flash Lidar. This mode of operation 
predicates on the concept tliat upon recognition of tlie fust available "safe" landing site, the landing vehicle will be 
directed to it. Continuous operation of the Flash Lidar down to about 100 m above the ground w ill allow for high 
precision landing within the identified safe landing area, to about a meter of margin. Tlie continuous operation of Flash 
Lidar at the video frame rate will also allow the determined "safe" location to !>c verified multiple times before the 
vehicle commits to touch down. To ensure tliat sufficient terrain area is monitored as tlie vehicle descends, an adjustable 
fteld-of-view (FOV) receiver optic is being considered. By increasing the receiver FOV according to its distance to tlie 
ground, the spatial coverage and resolution can be preserved. 




Figure 3. Tie hazard ifctcclion phase is expected lo begin when the Lander pilches over lo slart its approach descent to the surface 
The slope of descent can be adjusted lo allow for sensor field of view considerations and. if necessary, for human interaction 


3. TESTING AND EVALUATION 

The capabilities of the Flash Lidar technology for autonomous safe landing application have been investigated in a series 
of static and dynamic experiments at a sensor test range and from aircraft platforms. One of tlie major objectiv es of 
these tests was to define areas of technology improvement requited to meet NASA's autonomous safe landing needs. 
These tests also helped the development of various algorithms including image reconstruction. HDA. HRN. and TRN. 



Furthermore, the analyses of ihe test data allow improvement to the Flash hdit eomputei models used in end-to-end 
landing system simulations. All the Flash Lidar experiments to date base been based on the technology developed by 
Advanced Scientific Concepts (A SC)*'. This 3-D Imaging camera has a 128x128 pixel array capable of generating real- 
time image frames at up to a 30 Hz rate. Characterization of Flash Lidais and other remote sensing instruments are 
routinely made at tlie long-range test facility at NASA-LaRC. Analyses of the ASC Flash Lidar test results from the 
long-range test facility at NASA-LaRC for specific landing applications have been reported previously*. 

The ALHAT fust airborne tests of the Flash Lidar system were conducted aboard an AS-3S0 helicopter to assess the 
technology’s capabilities for terrain hazard detection. Figure 4 shows the ASC Flash lidar housed inside a gimbal licit 
points on command to the desired area. The transmitter laser generated 1 3 ml. 10 nsec pulses at an eye-safe wavelength 
of 1 .57-pm. Tlie 3 degree FOV, T2_2 receiver lens gave a 10 cm ground sample distance (OSD) from 2S0 m slant range. 
The helicopter flight tests were conducted alxive vegetation-free terrain at NASA Dryden Flight Research Center and 
Death Valley National Park m California. Hundreds of man-made rectangular and spherical targets with different 
reflectivity and varying sizes from 30 cm to several meters w ere placed and their locations registered (Figure 5). Several 
craters, each about 3 m in diameter and 1 m in depth, were also prepared for this test. Difterent flight patterns of up to 
500 m over tlie ground were employed over the target areas. Figure 6 is an example of tlie lidar data showing targets on 
the ground. A detailed analysis of the helicopter test results can be found in a recent publication . 




f igure 5. Hundred* of rectangular and hemispherical targets with varying sizes from 30 cm to several meter* placed at the test site and 

tlxir location registered along with several man- made craters. 



Figure 6. Ixamplo of Hash Lidar image Frame*. Left inugc shows hcmispbmcal and reclanguLir object*. and the ngbt image show* 

two boxes wilh one on lop of the other 


More recently, a similar flash lidar to the one used for tlie helicopter flight tests was integiated and flown onboard a 
fixed-wing an craft to assess its performance for multiple pixel altimetry and terrain relative navigation functions. The 
Flash Lidar was mounted on a gintbal aboard a Beech King Air B200 aireiaft, along with a lasei altimeter, visible 
cameras, and an inertial measurement unit (IMU). Several flights were performed ui areas of Death Valley and in the 
Nevada Test Site (NTS) with various flight piotiles and altitudes reaching over eight kilometers above ground level. TIk 
D eath Valley and NTS locations were selected primarily because of the topographical similarities to the lunar terrain. 
Figure 7 shows a mechanical drawing of the sensors mounted on the gimbal. 



Figure 7. Flash Lidar and Laser altimeter configuration on gimbal onboard a King Air fixed-wing aircraft 


To operate at long line of sight (LOS) ranges, the Flash Lidar transmitter beam divergence w as reduced, thus 
illuminating only a fraction of the FOV and a subset of (he focal plane array (FPA) pixels. In this mode, the Flash Lidai 
lias a much laiger operational range than when the full FPA is illuminated. Altlvough operational range is increased, the 
added concentration of energy on the illuminated pixels creates a gradient across the footprint of the beam on the ground 
that is greater than the gradient distribution obtained w hen the same laser beam illuminates die full FPA. Due to the 



temporal t espouse of the system to intensity 0 , this field test provides data tint is used to inv estigate and mitigate this 
effect from the sensoi for applications sueh as TRN. In preparation fot this field test, the Hash Lidar system perfoimance 
was well characterized at the Sensoi Test Range'’, and the sensoi ’s operational range profile w as predicted. 

The transmitter beam divergence is chosen before the flight to maximize the number of active pixels for the upcoming 
altitude profile. Beam divergence was selected by changing the magnification of the transmitter beam expander to lx 
(Bate Beam). 2x. Sx, or lOx. Table 2 below summarizes the flight missions and Hash Lidar transmitter configurations. 
Perfoimance of the sensoi during the shakeout flights and Flight I were used to estimate the correct beam divergence for 
all other flights. 


Table 2. Aircraft flight Tesl Campaign Summary 


Flights 

Area 

Xmtr Optic 

Attitude 

Comment 

Sn*coj*. 1 

NTS 

Sx 

1-8 km 

Na at data, weather Irtn red 

SJv*coj:2 

NTS 

2 x 

2 4 5 km 

303 BCO actrsc pacts 

StvHcaA'S 

NIS 




Flgh* 1 

DV 

Sx 

2 - 8 ton 

7S 250 xlivc pixels 

Flgtt2 

OV 

2 x 

-4 km 


Ft 

DV 

Sx 

B km 


Ftgtt4 




Canceled 

FlgHS 

NTS 

Bare Beam 

2-4 ton 

203 1CCO actr*e pacts 

Ft<^<6 

NTS 

ICta 

-8 km 

Na atirrcter. off foais 

FI #17 

NTS 

2 x 

2-4 km 


Fi^hta 

DV 

Sx 

-8 km 

Na aii meter, off focus 


The comments listed in the table are selected highlights of each particular flight. For example, the number of active 
pixels listed coiresponds to the resulting variations m number of triggered pixels from the lowest altitude to the highest 
altitude for that flight. The number of counts listed for Shakeout 3 highlights the fact that an average intensity of 1400 
counts was obtained at the aiicraft flight ceiling of approximately S km. using a 2 x beam expander on the transmitter 
while flying over NTS. This data was used to select all future NTS flight configurations since detection threshold is 
1000 counts. Figure £ shows tl*e average intensity per frame plotted against LOS range, data obtained from Flight S. 
The humps in intensity are due to sections of higher ground reflectance as the "racetrack" profiles were flown. 



B*ne-tm-t?i si 


Figure S. Average intensity in "counts” per frame vs LOS range. 



Figure 9 shows ihe received intensity naps of four consecutive frames. The intensity units are in counts, corresponding 
to the digital dynamic range of the ROIC. The horizontal and vertical axes arc pixels <128 x 1 28) of the FPA. At close 
inspection of these frames, one can recognize buildings moving across the FPA that are outside the illuminated pixels. 
These pixels are picking up background thermal radiation from the hot August Nevada sun. These images help the data 
analysis since the buildings were surveyed, and can provide range measurement truth to the 3-D reconstruction. The 
buildings also provide a quick look of the pulse-to-pulse area overlap of live beams on the ground. These images show 
that approximately 60% of tlie beam diameter overlaps (tom frame to frame. Although the beam divergence is fixed for 
each flight, the portion of the triggered pixels that overlap from frame to frame depends on frame rate, aircraft velocity, 
and signal to noise variables (SNR: altitude, atmospheric transmission, and ground reflectivity). 



figure 9. Intcnuly mapi of four consecutive frames obtained during flight 5. 


The 3-D range map ts drown in Figure 10 tor the same 4 frames of Figure 9. The beam footprints displayed in Figure 9 
show the gradients in live intensity distribution and Figuie 10 shows how these nonlineai variations aflect range 
measurement accutacy. Range correction algoiithms aic developed at NASA-LaRC based oil controlled calibration 
experiments performed at tire Sensor Test Range. 

The long-range laser ahimetei shared the gimbal w ith the Flash Lidar and measured the LOS range from a laser beam 
parallel to the Flash l.idn beam. This altimeter was developed in-house at NASA-LaRC in support of the ALII AT 
project. The altimeter has a low divergence transmitter and a narrow field of view receiver. The altinater FOV is under 
one milliradian. and its beam footprint on tire ground covers approximately four pixels of the Flash Lidar. The 
instrument las range measurement accuracy belter than 20 centimeters. The altimeter serves to eolleet independent 
range measurements that can be used to compare agaurst the multi-pixel ranges obtained from tlie Flash Lidar. 









figure 10. 3-D reconstruct im of the umc 4 frames shown in figure 9. 


Figure 1 1 shows a portion of Flight 5. comparing the laser altimeter to single pixel range measurements from the Flash 
Lidar. The difference in range between the two instruments is due to the geographical separation between the two laser 
learns on the ground. Performance of the Flash Lidar as a multi-pixel TRN mstiuntent is undet evaluation, and the 
icsults will be presented in futute publications. 



figure 1 1 . Later altimeter compared to a single pixel range measurements 






4. FLASH LIDAR TECHNOLOGY ADVANCEMENT 


The remits of the static ami airborne tests described above were proved critical in defining tlie areas of the technology 
improvement and development of signal processing algorithms necessary for achiev ing the ALHAT objectives and 
meeting NASA's autonomous safe landing needs. A series of Flash Luiar component technology advancement projects 
w ere initiated in 2008 in collaboration w ith industry, aimed at live development of a Flash Lidar landing sensor system 
that can efficiently perform the four functions described abov e. Table 3 summarizes the current state of the Flash Lidar 
technology and the performance goal of the current technology advancement activities. 


Table 3. flash Lidar ALHAT prrformaree goals 


Mode of Operation 

Parameter 

Current 

Goal 


Max operational range 

400 m 

> 1000 m 


Number of pixels 

128X128 

256X256 


FOV 

3 deg 

Variable 6 24 deg 

> 

Precision 

8 cm 

5 cm 

£ 

3? 

GSD 

20 cm 

10 cm 


Map size 

102 m X 102 m 

204 m X 204 m 


Map acquisition time 

1-2 sec 

1 sec 


Max operational range 

8 km 

20 km 

X 

Number of illuminated pixels 

10X10 

20X20 

z 

Precision 

20 cm 

20 cm 


Update rate 

30 Hz 

30 Hz 


These activities include the dev elopment of low noise 256x256 pixel Avalanche Photodiode array, high sensitivity 
256x256 Readout Integrated Ciicuit (ROIC), efficient transmitter laser with optimum pulse temporal ami spatial profiles, 
programmable tield-of-view receiver optics, and novel signal processing tecluiiques. Increasing the number of pixels by 
a factor of 4 and extending the operational range of the lidar by a factor 2.5 translates to 25X more sensitive oi more 
powerful system. This is expected to be achieved by increasing the detection sensitivity (i.e.. combination of the detector 
array ami ROIC performance) by I OX and by increasing the effective laser pulse energy by 2.5X. Tl»e generation of 3-D 
maps covering an aiea of the order of 200X200 meters with 10 cm resolution will be achieved by a combination of an 
advanced receiver optics design and novel signal processing techniques. A motorized optical mechanism is being 
developed to allow for increasing the lidar field of view as the vehicle descents thus preserving the coverage area during 
final approach phase. A set of signal processing algorithms aie being developed for accurate calibration of the lidar 
signal and enhancing the image resolution and reducing its noise through "super resolution" or "digital magnification” 
techniques. Upon completion, these component technologies will be integrated into a system to demonstrate the Flash 
Lidar capabilities in meeting ALHAT's objectives. 


5. CONCLUSION 

The Flash Lidar has been identified by NASA as a key technology for enabling autonomous safe landing of future 
robotic and crewed lunar landing v ehicles. Tlie capabilities of Flash Lidar technology were evaluated through a series of 
static tests using a calibrated target and through dynamic tests aboard a helicopter and a fixed wing airctarfl The aircraft 









































flight tests were perfomed over Moon-like letrain in the California and Nevada deserts. These tests provided the 
necessary data for the development of signal processing software, and algorithms for hazard detection and navigation. 
The tests hel|>ed identify technology areas needing improvement and will also help guide future technology advancement 
activ ities. The Flash Lidar component teelmologies being developed under the ALHAT piojeet w ill he integrated into a 
system capable of generating 3-D image frames with 256x256 pixels resultions from I km distance at 30 Hz rate meeting 
the specified goals for futute landing vehicles. 
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